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ABSTRACT 

The Computer Based Project for the Evaluation of 
Media for the Handicapped conducted a study to determine teachers* 
attitudes tovard the project and his/her knowledge of project 
operations. Tifenty-three teachers participated in interviews focused 
on three major areas: the student, the teachers, and the project. An 
interview checklist of 12 items was used by the interviewers to 
record the frequency of teacher comments. Completed interviews were 
analyzed using three predetermined attitude categories: positive, 
indifferent, and negative to the project as defined in criteria for 
judgement of teacher comments. The interviews produced 32 
recommendations aimed at improving interaction between the project 
and the teachers. Recommendations concerned information desired by 
teachers, teacher involvement, and input in some aspects of the 
project to facilitate student experiences, and procedures which may 
assist teachers in understanding project services. (Author) 
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Q A SURVEY OF 1972 TEACHER OPINION 

ABSTRACT 

The Computer Based Project conducted this study to determine 
teachers' attitudes toward the project and his/her knowledge of 
project operations. Twenty-three teachers participated in inter- 
views focused on three major areas: the students, the teachers, 
and the project. An interview checklist of 12- items was used by 
interviewers to record the frequency of teacher comments. Com- 
pleted interviews were analyzed using three pre-determined atti*- 
tude categories; positive, indifferent, and negative as defined 
in the criteria for Judgement of teacher comments- The interviews 
produced 32 recommendations aimed at improving interaction between 
the project euid the teachers. Recommendations concerned informa- 
tion desired by teachers, teacher involvement and input in some 
aspects of the project to facilitate student experiences, and 
procedures which may assist teachers in understanding project 
services. 
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SPECIAL REPORT No. 7217 
COMPUTER-BASED ..PROJECT for the EVALUATION 
of MEDIA for the HANDICAPPED 

T i t I e 1 A SURVEY OF 1972 TEACHER OPINION 

BACKGnOUND 

The Computer Based Project for the Evaluation of Media for the Handicapped, 
based on contract t}OEC-9-423617-4357 (616) between the Syracuse (N.Y*) City School 
District and the Media Services and Captioned Films Branch, Bureau of Education 
for the Handicapped (United States Office of Education) for the five year period 
July 1, 1969 through June 30, 1974, The major goal is to improve the instruction 
of handicapped children through the development and use of an evaluation syatcm 
to measure the instructional effectiveness of films and other materials with 
educable mentally handicapped (EMH) children, in-service training and media support 
for special teachers, and studies related to the evaluation process and the 
populations used. 

The Project has concentrated on the 600 films and 200 filmstrips from tlie 
Media Services and Captioned Films (BEH - USOE) depository; however, specific 
packages from Project LIFE, various elementary math curricula, and selected 
programs from Children's TV V/orkshop have also been evaluated. The evaluation 
model used requires that: 1) objectives of materials be specified and writteni 

2) instruments be constructed to test and measure effectiveness; and; 3) children 
be the major sources of evaluation information. A number of instruments and 
methodologies are employed in the gathering of cognitive and affective data from 
900 EMH children and 80 special teachers to make the effectiveness decisions. 
Over half of the EMH population can neither read or write; therefore, a unique 
Student Response System (SRS) iy employed, consisting of a twenty station G.E.- 
1000 SRS which can be operated in a group or individual recording mode and is 
connected to a remote computer system* The computer capabilities consist of 
remote telephone , connections to t'ne Rome (N-Y.) Air Development Command, the 
Honeywell time-shared network, and the Schenectady (N.YJ G E Research and 
Development Center; and batch mode capabilities of the Syracuse City Schools, 
Syracuse University, and various commercial sources. 

In-service and media support activities provide on-the-job training for 
teachers, teacher aides, equipment, and materials to the special teachers in 
the city schools. The research activities have centered around investigations 
and special problems related to the development of the evaluation model. The 
four major areas considered are: 1) testing effects, 2) captioning effects, 

3) special student characteristics; and, 4) evaluation procedures validation. 

Documentation of the major activities appear in the five annual reports 
and the 600 evaluations prepared on materials used. Staff members v/cre encouraged 
to prepare special reports and the attached paper is one of these. The opinions 
expressed in tliis publication do not necessarily reflect the position or policy 
of the Computer Based Project, the United States Office of Educatiojn, or the 
Syracuse City School District, and no official endorsement by any of the agencies 
should be inferred. 
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A SURVEY OF 1972 TEACHER OPINION 

The Computer Based Project relies on the responses of special 
students to provide evaluation data to determine the instructional 
effectiveness of films* Various environmental » social and situation- 
al factors influence these responses of the students, The important 
factor influencing student performance may ^e the classroom teacher 
attitudes and remarks* 

The pv^rpose of this study was to determine a teacher's attitudes 
towards the project and her/his knowledge of its operation* Of the 
28 teachers who bring their students? to the project, 23 teachers were 
interviewed while their students w. *"ched a film in the project facili- 
ties on one regularly scheduled visit; Interviews uere conducted with 
the aid of guidelines listing questions in three major areas: the 
students, the teachers, and the project. The teacher was seated in a 
lounge atmosphere and served coffee. The interview was conducted as 6 \, 
subjective discussion with the interviewer marking the item category 
based on the comments of the teacher and asking for verification of the 
classifications. The criteria for assigning comments to positive, in- 
different, or negative groupings were determined before reading the 
teacher ^8 comments* 

Completed interviews were analyzed using the pre-determined three 
category system: positive, indifferent , or negative. A positive response 
was generally considered to be one favorable to CBP and its program. A 



negative response v*as generally considered to be one that vas unfavorable. 
An indifferent response shoved no interest in the project. The response 
of a teacher vas assigned to that category vhich conformed to the defini- 
tion of positive, indifferent, or negative. 

Criteria for Judgment of teacher comments 

......... . ... y: 

The effect of coming to the pro , 1ect ; 

POSITIVE 1, The Ss enjoy coming to the project* 
2. The Ss benefit from the experience. 

INDIFFERENT 1. No opinion. 

NEGATIVE 1, The experience is detrimental, 

2, The Ss express a desire not to come, 

II, The student's opinion of the film 

POSITIVE 1. Students learned from the films, 

2. Students enjoyed the films. 

3. Students attended to the film, in the 

opinion of the teacher, 
I4. Students discussed the film in class or 

at another time. 
5. Students liked most of the films shovn, 

INDIFFERENT 1, The students enjoyed some films but did not 

enjoy all the films, 
2. No information vas communicated to the teacher 
about the students' opinions of the films, 

NEGATIVE 1. The students did not enjoy coming to the 

films at any time. 

III. The students' opinion of the questions 

POSITIVE 1. The students enjoyed ansvering questions, 
2. The students enjoyed pushing buttons, 
3* The students benefitted from the testing, 

INDIFFERENT 1, The students did not express an opinion to 
'"^^ the teacher. 

2. The students like some of the questionn but 
: not all the questions. 

3. Some of the questions vere considered too hard. 

NEGATIVE 1. The children did not enjoy the questions. 



IV. The effect of tiusinj;; on the students 

POSITIVE 1. The students enjoy the bus ride* 

2. The bus ride provided a new experience! 

INDIFFERENT !• No opinion was expressed. 

NEGATIVE 1* Students do not like the bus ride. 

V. Opinion of coming to Computer Based Pro.lect 

* POSITIVE 1. The time at CBP is a free period for the 

teacher. 

2. The period allowed the teacher to meet new 

people. 

3, The teacher enjoyed the bus ride with the/ 

students . 

I4. The teacher enjoyed viewing the films* 

INDIFFEBEN^r 1. Teachers who did not come to CBP with the 

students. 

2. Teachers who have no opinion on coming to CBP. 

NEGATIVE 1. A teacher who expressed a dislike of coming 

to CBP, 

2. The idea that the students are being used by 

coming to CBP. 

3. Teachers who do not send their classes although 

they are scheduled* 

VI. Opinion of the films shown 

POSITIVE 1, The films were good for all or most of the 

students • 

INDIFFERENT 1. Some of the films were good/ some were bad. 
2. The teacher did not watoh the films. 

NEGATIVE 1. Most of the films are not appropriate to the 

students. 

VII. Opinion 6f the questions 

POSITIVE !• There was a carry over from the project 

questions to the classroom. 

2. The training was valuable . 

3, Questions were good. Some questions were good. 



VII, opinion of the Questionsl continued 



INDIFFERENT 1. Teacher had never seen questions, 

2* Some questions were good, some of the 
questions vere not. 

NEGATIVE 1, There was no value to the questions ♦ 

2, There was no carry over from the project 

to the classroom. 
3- The questions were too long. 

VIII. Does the training in answering questions gained at the pro.ject 
help the teacher with classroom questions? 

POSITIVE 1. Training carries over to the classroom. 

INDIFFERENT 1. No opini<?n . 

2. The teacher does not use multiple choice 
questions in class. 

NEGATIVE 1. There is no^carry over with questions, 

from the ^project to the classroom. 

IX. The teachers^ opinion about CBP's evaluation method . 

POSITIVE 1. Good 

2. Usable 

INDIFFERENT 1. No idea. 

NEGATIVE 1 . Worthless , etc. 

2, Detrimental for students. 

3. Laboratory situation. 

X. O pinion of Trial_G 

POSITIVE 1. Good procedure. 

INDIFFERENT 1. Lack of knowledge. 

. NEGATIVE 1. Too many films. 

2. Bad procedure, 

XI. Comments on GBP Summer Workshop held in summer 1^71 

POSITIVE 1. Learned 

2. Reinforced ' 

3. Using material that was learned there. X. 
M&Miy;S^ • Would c ome ■ agai n. 



XI, Comments on SxiMier Workshop continued 

INDIFFERENT 1. No opinion jno comment. 
NEGATIVE 1. Did not enjoy the workshop • 

XII. Opinion of CBP Staff 



POSITIVE 


1. 


Helpful 




2. 


Courteous 




3. 


Competent 


INDIFFERENT 


1. 


No comment 


NEGA'PIVE 


1. 


Late 




2. 


Disorganized 



RESULTS 

The frequency of comments in each of the three categories was 
summarized by items in Table I 

TABLE I - Frequency of Response by Interview Iten 



- . ■■ \^ ■'■ ■■. ■ . ... Posi- Indif- Nega- 

Intervlev Item live ferent tive Total 



Effect of coming to the Project 22 1 23 

Ss opinion of the films 10 ^ \ 17 

Ss opinion of the questions 7 7 3 U 

The effect of busing on the students 10 1 ii 

Opinion of corning to Computer Based Project 20 3 ^ 27 

Opinion of the films shovn 7 16 5 25 

Opinion of the questions ^ 17 7 

Does the training in answering questions gained 
at the project help the teacher with class- 
room questions 
The teachers' opinion about GBP's evaluation 

method 
Opinion of Trial C 
Comments on CBP 1971 Summer Workshop 
Opinion of the CBP Staff 
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The total frequency varies from the total number of teachers intern- 
viewed because (l), the teachers expressed more than one conimenti (2) the 
definition of the categories could place a teacher's attitude without an 
interview cotnment, and (3) some teachers didn't answer specific questions 
on the interview form. 

The similarities in positive, indifferent or negative opinions as 
expressed by the teachers were summarized by question. 

• • • V 

Suimnary of the Actual Responses by Item and Category 
I . The effect of coming to the project * 

POSITIVE 1. The students enjoy coming. (19) 

2. The experience is good for the students* (3) 

3. It is a break from the routine — gets students 
out of the room, (3). . 

l4, A lot- of incidental learning takes place, (2) 

5, Students have become better listeners, (2) , 

6, The students look forward eagerly to the activity, (2) 

7, The experience gives students a sense of responsibility. 

8, It's the only chance they have to see a film, 

% INDIFFERENT — none 

NEGATIVE 1, The students participated In an experiment to 
obtain profiles and did not like it. 

2. The confirmation of correct answers had a detrimental effect, 

3, The students objected to questions about a film they 
had not seen. 

II, The students/ opinion of t h e films ; 

POSITIVE 1. The students on the whole like the filias. (5) 

2, The students like or enjoy the films* (3) 

3. The students learn from the films. 
1*; The films are appropriate. 



INDIFFERENT 

1. No opinion (6) 

2, Students like some films, (2) 

3» No feedback from the students unless the teacher asks 
the students • (2) 

Children act up more during fiLns not at their level.,, 
NEGATIVE 1. Most of the films are horrible. 



III. The students' opinion of the q,uestions 

POSITIVE 1, They like answering questions, (3) 

2. The questions do not bother them, (2) 

'3. The confirmation helps. (2) 

^l*. The questions are easy, 

^5. Getting the questions wrong is not detrimental. 

6, The students like pushing buttons. 

INDIFFERENT 

1, The^ students never speak about the questions. (6) 

2. Some questions are too hard. 

3# The students are not thrilled by the questions but they 
answer them. 

NEGATIVE 1. The questions are too difficult. 

2. Confirmation of correct answers is detrimental to 
the students. 

3i Students do not regard questions seriously, 

U, Students have no idea of which responses are correct, 

5- Some questions are too long. 

IV. The effect of busing; on the students 

POSITIVE l. The students like or enjoy it. (7) 

2^ It's like a field trip. 

3. No objection to the bus. 

I4. The students have a new experience on the bus* 

5» The bus provides a period of social activity 1 

INDIFFERENT - Students made no comment. 



NEGATIVE 



Vi Teacher opinion of cominp to Computer Based Project 



POSITIVE 1 . 

2. 
3. 

5. 



The teacher enjoys coming to the project. (lO) 
A free period. 

The teacher likes having the students at th'e project. (3) 
Riding on the bus with the students is great. 
Time to look over the project materials. 



INDIFFERENT 



1. Teachers who do not come to CBP with their students. (11) 



NEGATIVE 1. 

2. 



The students are guinea pigs. 
The experience has no valuo. 



VI, Opinion of the films shown . 



POSITIVE 1. 

2. 

INDIFFERENT 
1. 
2t 

NEGATIVE 1. 

2. 



Films are generally good. (6) 
Teacher has learned from the films. 



Did not watch the films. (15) 
Some are "good; some are bad. (3) 

Films are inappropriate. (2) 
Would not show them in my class. 



VII. Opinion of the questions 

POSITIVE 1. There is a carry over to other situations, (g) 

2. The students benefit. 

3. The teacher likes the way we present questions. 



INDIFl^ERENT 
1. 
2. 

NEGATIVE 1. 

2. 



The teachers did not see the questions # (l5) 
The students should be asked no more than ten questions. (2) 

Questions are unclear. (3) 
Questions are too hard. (2) 
3. Vocabulary is inappropriate, (2) 

Don^t like the pretest^ posttest combination. (2) 

5. Revisions of the questions are needed. 

6, No carry over to the classroom. 



VIII, Does the training in answering questions gained at the project j 
help the teacher with classroom questions? 



POSITIVE 1, 
2. 

IM^^^^^^ 3.: 

imm:. , 

5. 



Students have learned the idea of testing, (3) 
The training in answering questions helps the students, (3) 
Answering questions is a good experience for the students, (s) 
Questions do not have to be read so many times in class i 
Students are not so frightened of testing. 
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VIII. Continued 



INDIFFERENT 

1. The teacher does not use multiple choice questions 
in class, 

NEGATIVE 1. There is no carryover, 

2. There is no real training going on. The students 
knew it be fore • 

3. Not that I knov of/ 



IX. The teachers' opinion about CBP's evaluation method 

POSITIVE 1. Would use the same method, (3) 

2. Good (3) 

3, Satisfactory, 

INDIFFERENT 

1, Don't knov what CBP is, (3) 

NEGATIVE 1. Situation too sterile • 

2» Not a controlled situation, 

3. Not enough positive reinforcement and repetition 
for the students. 



X, Opinion of Trial C 
POSITIVE None 

INDIFFERENT 

1, No comment. (2) 

2, Not familiar vith Trial C. (7) 

3* Using the Trial C evaluations but unfamiliar with the 
process. 

NEGATIVE 1. Films are not good. ' \ 

2. Too many questions and some of the questions are 
inappropriate, 

3» Questions are not a good judge of what the student learned. 



XI, Comments on CBP Summer Workshop held in summer 19 , 71 

POSITIVE 1. Like and enjoyed the workshop. (3) 

2, Learned a lot about films i 

3. Would be more valuable this year, 
1|, Liked money* 



XI • Continued 



INDIFFERENT None 

NEGATIVE 1\ Not enough individual practice. 

2, Too much lecturing. 

XII. Opinion of CBP Staff 

POSITIVE 1. Cooperative (h) 

2. Friendly. (3) 

3. Good (3) 

k. Qualified (2) 

5. Competent 

6. Enjoyable 
T. Prompt 

8. St i dents like staff 

indifferent' None 

NEGATIVE Could use more discipline in the teat situation, 
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SUGGESTIONS MADE BY TEACHERS 



What could CBP do to make the viewing experience more meaningful 
and enjoyable? Twenty teachers responded. 

It Select films that are relevant to the students (9> 

2. Keep the songs after the films (5) 

3. The situation is fine as it is (h) 

A follow-up discussion should follow films 

5. Make questions meaningful 

6. Tell the students they don't have to get all answers correct 



What types of films would the teacher use? Thirteen teachers 
responded and gave the following categories of films they would 
show their classes: 

(9) 
(8) 

(IM 
(15) 
(16) 
ill) 
(12) 
(13) 
(10). 



1. 


Health 


(3) 


8. 


Solving problems 


2. 


Seasonal 


(3) 


9. 


Families 


3. 


Science 


(M 


10. 


Animated 




Correlated 


with classroom 


11. 


Discussion 




work 


(3) 


12. 


Animals 


5. 


Safety 


(7) 


13. 


Stories 


6, 


Affective 


(5) 


Ih. 


High interest 


7. 


Films at the students 'level 


15. 


Telling time 






16. 


Social studies 



Activities that use films. Six teachers responded, 



1, 
2. 



Discussion 
Film alone 



3* Show the film over 
I4. Projects and pictures 



Ways teachers evaluate films. Thirteen teachers responded* 



1. Watch the students' reactions 

2. Student responses to questions 

3. Preview. films (3) 
Show film and have a 
discussion (3) 

5. Student learning 

6. Base Judgment on student 
questions 

7. Ask questions 

8. Ask students to act out some- 
thing they saw in the film 



(6) 10. Use CBP method with 
(6) one student 

11, No questions after the film 

12, Film meets objectives 

13 , Several teachers rate film 
1I+, Read catalog for description 

of film 

15. Language 

16. Relevance 

IT. Relevant content 

18, Personal Judgment 
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Ei Ways CBP can help teachers • Fifteen teachers responded. 



1, Provide a Structure of the Intellect Profile for each childi (1+) 

2i Make mediated materials and machines available to teachersi {U) 

3. Provide a casette recdrder for the- classroom* (2) 

k. Tell teachers what will be shown. (2) 

5t Have teachers view films, (2) 

6* Summer workshops, 

7» Help communicate with the students/ 

8. Get films on special topics , 

9t Send relevant films, 

10. Give feedback on student performance, 

111 Visit schools to better understand the students, 

12, Include with the film, packets of other teachers/ evaluations, 

13i Provide sheets with salient points of the films noted, 

Ih. Make catalogs available at the project listing the films. 

15 • Make teachers aware of available films. 

l6. Work on instructional units. 

17 • Provide consultant to help use media in the classroom* 

18. Find out what teachers are doing and coordinate activities t 

19» Ask more questions of the teachers. 



F, Ways to improve film service, Ten teachers responded. 

1, Two teachers said that the service was excellent, 

2, A catalog of the films available for viewing is needed, (2) 

3, Make a book for scheduling films available to teachers* 
U, Scheduling needs improvement* 

5 • Obtain films for the teacher in her own classroom as part of her 
teaching procedure, 

6. Let more teachers know about the facilities* 

7. People often confuse two facilities — the CBP and Special Projects 

8. Be more organized. 

9» Speed up the procedure. 



RECOMMENDATIONS 



Among the moBt important recommendations in this report are the following! 
1» The teachers must be informed at every stage of the project 

activity. Teachers should know what is going on and vhy# 
2i Films and questions must be chosen carefully with the students V 

needs in mind, 

3» The opinion of teachers must be sought continually* ' 
The specific recommendations include: 

1, Aneilyze the responses above aud determine the suggestions which 

can be implemented* 
2| See if the films on these topics can bv3 scheduled* 
3* Determine if any of the above can be added to the CBP evaluation 
model. 

U I Publish a short (five page) paper on the purpose of CBP. 

5» Invite teachers to a seminar on CBP using audio-visual aids to 

explain the purpose of the project. 
6. Read the above comments and determine which can be implemented. 

If one cannot explain to the teacher why it cannot* 
7* If CBP is to continue as a film distribution agent , the project 

should do the Job very efficiently, 

8. Teachers should be made aware of the constraints and limitations 
affecting the project ^s service. 

9, Distinguish between the CBP and Special Projects. 

10. Discontinue all profile experiments with the class in question* 



Reconunendations, continued 

11. Do not present questions dealing with a film that was not shown, 

12. Choose films more carefully for the class in question. 

13. Choose questions with consideration for the grade level • 

ll+i Ask the teacher whether confirmation of correct answers should 
be given to the students, 

15. Write and edit questions carefully. 

16. Activities which could be related to the films should be 
suggested for the teachers to try in their clap rooms, 

17. Choose the films carefully. Explain the "why" of showing 
inappropriate films to teachers, 

18. Edit or drop bad questions. 

19. Have only one correct answer for each question. 

20. Re-examine the need for pretest questions, 

21. Use Stanwix House Word List as a guide in writing questions. 

22. Explain the evaluation system to teachers in a briefer form 
than the quarterly report which dealt with evaluation at length . 

23. Questions should be numbered differently from answer foils • 
Allow space on the student answer forms for a written answer • 

25. Screen questions carefully. 

26. Re-assess the value of Trial C for final evaluation reports* 

27, If the workshop is held again there should be more individual 
: practice and less lecturing, 

28, Teachers seem to want to attend another workshop, ; ; 
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